Joint watermarking of audio-visual data

Both audio and video watermarking enable copyright protection with owner or customer authentication and the detection of media manipulations. The available watermarking technology concentrates on single media like audio or video. But the typical multimedia stream consists of both video and audio data. Our goal is to provide a solution with robust and fragile aspects to guarantee authentication and integrity by using watermarks in combination with content information. To achieve this, video stream parsing capabilities have to be added to existing watermarking algorithms. We propose to extract the audio and video content, called feature, and embed the content features with a robust watermarking scheme into the audio and video data. These features of audio and video data have to be identified. Watermarking payload and feature data requirements have to be compared. In this paper, we describe our current state of work in audio and video processing. We introduce a new approach for video content security. Our new approach is to embed watermarks both in video and audio channels of a MPEG System stream to increase security against attacks on content integrity. We discuss features of multimedia data suited for mutual integrity protection and watermarking algorithms, describe a MPEG System stream parsing system and finally show how this components work together to provide security for multimedia data.